mi ii ii ii 111 1 linn 1 1 111 mil 

(11) EP 0 874 520 A2 

(12) EUROPEAN PATENT APPLICATION 

(43) Date of publication: ( 51 ) | nt . CI. 6 : H04N 1/41 

28.10.1998 Bulletin 1998/44 



(21) Application number: 98201160.3 

(22) Date of filing: 11.04.1998 



(84) Designated Contracting States: 


(72) Inventors: 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


• Bryniarski, Gregory R., 


MC NL PT SE 


c/o Eastman Kodak Company 


Designated Extension States: 


Rochester, New York 14650-2201 (US) 


AL LT LV MK RO SI 


• Wilson, Brian R., 




c/o Eastman Kodak Company 


(30) Priority: 24.04.1997 US 842453 


Rochester, New York 14650-2201 (US) 


(71) Applicant: EASTMAN KODAK COMPANY 


(74) Representative: 


Rochester, New York 14650 (US) 


Lewandowsky, Klaus, Dipl.-lng. et al 




Kodak Aktiengesellschaft, 




Patentabteilung 




70323 Stuttgart (DE) 



(54) Photographic image compression method and system 



(57) A method of compressing a collection of 
images using a variable compression function. In one 
aspect, the method comprises compressing the set 
using an initial function. The size of the resulting com- 
pressed image set is compared with a predetermined 
storage capacity. The function is altered based on the 
difference between the size of the resulting compressed 
image set and the predetermined storage capacity. The 
collection of images are compressed using the altered 
function. 
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Description 

FIELD OF THE INVENTION 

This invention relates to a method and apparatus 
for compressing a collection of images for storage. 

BACKGROUND OF THE INVENTION 

Recently services are being offered where a cus- 
tomer requests a photofinisher to process (that is, 
chemically develop a roll of film carrying a latent image 
to yield a fixed image) a roll of film and also provide dig- 
itized versions of the photographic images on a storage 
medium, such as a floppy disk. Because photographic 
images require large amounts of digital data, and the 
floppy disk has very limited storage capacity, the digital 
photographic image files are typically compressed 
using standard compression methods. 

For image compression systems, a fundamental 
distinction can be made between lossy and lossless 
compression systems. A lossless compression system 
will compress and decompress image data in such a 
way that decompressed image data is exactly the same 
as the originally input image data. In comparison, the 
decompressed image data resulting from a lossy com- 
pression system will be different from the originally input 
image data. The human visual system has a minimum 
detectable threshold that allows us to perceive as the 
same an original and its decompressed image that have 
some small amount of real difference between them. By 
taking advantage of this human visual system thresh- 
old, a lossy compression system can provide a higher 
compression rate without visible degradation in an 
image. 

Another fundamental distinction between image 
compression systems can be made between variable- 
rate systems and fixed-rate systems. Rate refers to the 
number of bits required after compression to represent 
a given spatial unit (for example, bits/pixel, bits/image, 
bits/image collection, and the like). A variable-rate com- 
pression system is one that produces a variable output 
data rate, depending on the properties of the input 
image data. Conversely, a fixed-rate compression sys- 
tem is one that produces a constant output data rate, 
regardless of the input image data. 

The fundamental trade-off in lossy compression 
systems is between compressed data rate and image 
quality. For a constant level of image quality, a higher 
rate is generally needed for an image or image region 
containing significant detail (that is. signal energy), as 
compared to a relatively low detail image or image 
region. A variable-rate system is well-suited to providing 
a constant level of image quality, since bits are 
expended as needed to match the image or image 
region characteristics. In comparison, a fixed-rate sys- 
tem must compromise on image quality for those 
images or image regions where the available number of 



bits is insufficient. 

When photographic images are compressed using 
a variable rate lossy compression method, such as 
JPEG, it is difficult to predict what the final compressed 
5 file storage space will be because the actual image con- 
tent of an individual image will impact the final file stor- 
age space of that image. It is easy to predict the size of 
a compressed file when a fixed compression method is 
employed. 

10 In designing a compression system, an example of 
a variable-rate lossy compression method is the JPEG 
(Joint Photographic Experts Group) international stand- 
ard, as described by W.B. Pennebaker and J. L. Mitch- 
ell, "JPEG: Still Image Data Compression Standard," 

75 Van Nostrand Reinhold, New York 1993. This reference 
and all other references cited herein are incorporated by 
reference. The JPEG system parameter that exerts the 
largest effect on the compressed data rate is the quan- 
tization table specification. There are many possible 

20 methods to adjust the JPEG quantization table in order 
to achieve a predictable file storage space for the image 
collection. The most straightforward method is to start 
with an initial quantization table, compress an image or 
collection of images, and then adjust the initial table by 

25 a multiplicative scaling factor if the desired rate is not 
achieved. A scaling factor greater than one results in 
more quantization and hence a lower rate than achieved 
with the initial quantization table. Likewise, a scaling fac- 
tor less than one results in less quantization and hence 

30 a higher rate than that achieved with the initial quantiza- 
tion table. If the desired rate is not achieved after the 
first adjustment, this adjustment process can be iterated 
(that is, repeated) until the rate constraint is met. To 
make such an approach useful in practice, it is neces- 

35 sary to achieve the desired rate in only a few iterations. 
When the same JPEG parameters are used to 
compress two different images, each image results in a 
different final compressed file storage space due to the 
contents of the different images. This makes it impossi- 

40 ble to predict how much file storage space is required to 
store a collection of images until the images have actu- 
ally been compressed. 

When trying to guarantee that a collection of com- 
pressed images will fit on a limited storage medium 

45 such as a floppy disk, a fixed set of JPEG compression 
parameters could be chosen to insure that all images 
can be compressed to fit on the disk even if all of the 
images were highly detailed. Such a set of fixed com- 
pression parameters, because they are selected to 

so accommodate the worst case scenario of all images 
containing high amounts of detail, will over-compress 
most images. Unfortunately, the more a photographic 
image is compressed, the more image quality that is 
lost. Over-compression of photographic images using a 

55 lossy compression method results in lost image quality. 
In addition, when a consumer has a photographic 
film processed and the images thereon scanned, with 
some images the degree of compression required even 



3 



EP 0 874 520 A2 



4 



to barely fit the images on a limited storage medium, 
such as a diskette, will produce compressed images 
with unacceptable loss in image quality. 

It is therefore desirable to have a compression 
method that determines the minimum compression nee- 
essary for a collection of images so that the actual com- 
pressed collection will fit within a limited storage space, 
such as that provided by a floppy disk, without being 
over-compressed, so that almost all the available stor- 
age space is used. It would also be desirable if for a 
given collection of images, that the compression 
method recognizes that the compression required to fit 
the collection on such a fixed capacity medium pro- 
duces unacceptable losses and compensates for this 
situation. 

SUMMARY OF THE INVENTION 

The present invention then, provides a method for 
determining the minimum compression needed to fit a 
collection of images within a limited storage space with- 
out undue wasting of the available space. That is, the 
present invention provides the required degree of com- 
pression to fit the collection within the limited storage 
space, but with minimum image quality loss from a lossy 
compression method. Furthermore, the present inven- 
tion provides a means for evaluating, for a given collec- 
tion of images, when the compression required would 
produce unacceptable image quality loss, and for com- 
pensating for this situation. 

In one aspect of the present invention there is pro- 
vided a method of compressing a collection of images 
using a variable compression function, comprising: 

(a) compressing the set using an initial function; 

(b) comparing the size of the resulting compressed 
image set with a predetermined storage capacity; 

(c) altering the function based on the difference 
between the size of the resulting compressed 
image set and the predetermined storage capacity; 

(d) compressing the collection of images using the 
altered function. 

In another aspect of the present invention, there is 
provided a method of compressing a collection of 
images using a variable compression function, compris- 
ing: 

(a) compressing the set using an initial function; 

(b) comparing the size of the resulting compressed 
image set with a predetermined storage capacity; 

(c) determining an altered compression function 
based on the difference between the size of the 
resulting compressed image set and the predeter- 
mined storage capacity; and 

(d) comparing the altered compression function 
with a predetermined maximum compression func- 
tion and. when the maximum compression function 



is exceeded, splitting the collection of images into 
multiple image sub-collections. 

Apparatus for executing the above methods is also 

5 provided. 

The apparatus and method of the present invention 
can provide the minimum necessary lossy image com- 
pression for all collections of images. That is, a collec- 
tion of images can be compressed just enough to fit on 

10 the storage medium and not more. Because image 
compression is minimized while meeting the foregoing 
storage medium capacity constraint, image quality of 
the compressed images is maximized. The use of the 
file storage space error (that is, the difference between 

15 the size of a compressed image collection and the stor- 
age media capacity) to adjust the degree of compres- 
sion (that is, the compression function), results in much 
more accurate file compression, as compared to meth- 
ods that would just select the next available compres- 

20 sion increment provided by a look up table. 
Furthermore, the method of the present invention can 
automatically divide a collection of images into sub-col- 
lections when the resulting required compressed collec- 
tion storage space exceeds the storage media capacity 

25 such that an unacceptably high degree of compression 
would be required (which leads to compressed images 
of unacceptable quality). Also, each sub-collection of a 
divided collection of images can be stored by the 
method at a minimum necessary compression for each 

30 storage medium (such as each floppy disk), resulting in 
the maximum image quality for each image collection. 
Because all images in an image collection are com- 
pressed using the same parameters, the images are 
perceived to have a higher quality by users. The method 

35 and apparatus of the present invention, while they can 
be used for various purposes, have particular applica- 
tion in scanning and storing images from a developed 
photographic film onto one or more fixed capacity 
media, such as diskettes. 

40 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram illustrating an apparatus 
of the present invention; 
45 FIG. 2 is a flowchart illustrating a method of the 
present invention; 

FIG. 3 is a graph showing the relationship of com- 
pressed file storage space versus scaling factor for 
high, average and low frequency images; and 
so FIG. 4 is a graph showing the change in file storage 
space versus scaling factor for high, average and 
low frequency image contents. 

To facilitate understanding, identical reference 
55 numerals have been used, where possible, to designate 
identical elements that are common to the figures. 
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DETAILED DESCRIPTION OF THE INVENTION 

Referring first to FIG. 3, this shows a graph plotting 
the resulting compressed file storage space versus a 
JPEG scaling factor. Images containing little detail 5 
result in smaller compressed file storage space, while 
images containing lots of detail have dramatically larger 
compressed file storage spaces. Even using an average 
value (representing images with an average amount of 
detail) can result in large errors between the actual 
compressed file storage space and the estimated aver- 
age compressed file storage space. FIG. 4 presents 
similar information, this time showing the rate of change 
in the compressed file storage space versus scaling fac- 
tor (that is, FIG. 4 represents the change of slope in the 
plots of FIG. 3). The non-linear variability shown in 
these plots emphasizes the difficulty in predicting what 
the actual compressed image file storage space will be 
using any given fixed set of JPEG compression param- 
eters. Thus, it can be seen from FIGS. 2 and 3 when 
photographic images are compressed using a variable 
rate lossy compression method, such as JPEG, it is dif- 
ficult to predict what the final compressed file storage 
space will be since the actual image content of an indi- 
vidual image will impact the final file storage space of 
that image. 

Referring to FIG. 1 , the apparatus may be that used 
in a typical retail or wholesale photof inishing operation. 
There is included a developer 10 which can chemically 
process an exposed silver halide photographic film 12 
(delivered to developer 10 inside canister 11) bearing 
latent images, to provide a collection of physical images 
14 in fixed form on the film. A scanner 20 is capable of 
scanning each of the series of images 14 on developed 
film 12 to yield a corresponding digital image signal, in a 
known manner using a source of illumination which 
passes through images 14 (or is reflected from images 
which may be on a reflective base, such as paper prints) 
onto a sensor. Scanner 20 is sometimes referred to as a 
film digitizer. Such scanners take a variety of forms and 
the various common aspects of film digitizing, particu- 
larly line illumination and linear CCD-based digitizers, 
are described in greater detail in commonly assigned 
U.S. Patent No. 5,012,346. However, other scanners, 
such as area array scanners, are also well known. An 
image signal processing apparatus 22 includes a digital 
processor 24 connected to receive the digital image sig- 
nals (a digital image collection) corresponding to the 
film images and compress them using JPEG or some 
other lossy variable compression function algorithm. 
Processor 24 is preferably a general purpose digital 
computer processor suitably programmed to execute 
the steps of the method of the present invention. How- 
ever, it will be understood that the functions of suitable 
programmed processor 24 could be provided in part or 
completely by fixed circuit elements. Apparatus 22 fur- 
ther includes a memory 26 for holding data required by 
processor 24 as well as a media writer 30. An optional 



monitor 27 and optional operator input 28 (such as a 
keyboard or mouse) may be provided to allow a system 
operator to view progress of scanning rolls of film and 
input various commands (such as stop, start, redo a 
particular film 12, and the like). Writer 30 can preferably 
write onto one or more removable blank writable media 
40 simultaneously, which may be fed automatically into 
and out of writer 30 under control of processor 24. The 
media on which writer 30 writes, is a fixed storage 
capacity media most typically in the form of a magnetic 
diskette. However, writer 30 can be such as to be capa- 
ble of recording on other media, such as any optical or 
magnetic media, or solid state media, of fixed storage 
capacity. The components of the apparatus of FIG. 1 
are typically found at the same location (that is, in the 
same building). However, one or more of the compo- 
nents can be positioned remotely from the other(s) (that 
is, in a different building which may be one or more 
miles away from the location housing other of the com- 
ponents). For example, developer 10 may be remote 
from the location of apparatus 22 and connected thereto 
over a suitable wired or wireless communication chan- 
nel, such as the internet, another public network con- 
nection, or a dedicated communication channel 
(including a dedicated computer network). 

In operation, a user brings or has sent to the loca- 
tion of developer 10, one or more exposed photographic 
canisters 1 1 each containing an undeveloped film carry- 
ing one or more latent images. Developer 10 then proc- 
esses these to yield a collection (that is, more than one) 
of fixed images 14 on the film 12. The film 12 bearing 
the fixed image collection is then transferred to scanner 
20 where a corresponding digital image collection is 
generated and transmitted to processor 24. In other 
cases, a user may simply bring in an already developed 
film strip 12 for scanning. Processor 24 then com- 
presses the image collection (it will be understood at 
this point that the signal representing the image collec- 
tion is being referenced) in accordance with the steps of 
the method discussed below, and causes the com- 
pressed image collection to be written by writer 30 onto 
a single removable storage medium 40 or causes image 
sub-collections (typically ail of which are compressed) 
onto one or more removable storage media 40. 

Turning now to FIG. 2, the sequence of steps by 
which the method of the present invention is executed 
by processor 24 will now be described. The collection of 
images is input (100) to processor 24. The predeter- 
mined storage capacity in the form of the size of a stor- 
age medium 40 on which the compressed image set will 
be stored, is determined (1 02). The size from step 1 02 
is divided by the number of images in the collection to 
determine the predetermined average image size (104). 
A look-up table consisting of compression scale factors 
and compressed average image sizes at the respective 
scale factor is used to determine an initial scale factor 
(108). The different scale factors in a single JPEG com- 
pression algorithm provide different compression tune- 
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tions. The table is traversed until a scale factor is found 
with an average size less than or equal to the predeter- 
mined average image size (from step 104). The collec- 
tion of images is compressed using the initial scale 
factor determined from step 108 (110). The resulting 5 
size of the collection is determined (112) followed by a 
determination if the compressed image collection will fit 
within the size of the storage space (1 14). if the collec- 
tion does fit the compression process is complete and 
the collection is stored (116) on a single storage w 
medium 40 by writer 30. If the collection does not fit then 
the method determines if the maximum scale factor was 
used (118) (that is, if a predetermined maximum com- 
pression function exceeded). 

If the maximum scale factor was used then the col- 75 
lection of images is divided into two or more sub-collec- 
tions each corresponding to one of a plurality of 
independent storage media 40(120). Each of the sub- 
collections is then subjected to the cycle of steps 100 
through 114, 118 and 120 using the sub-collection as 20 
the input collection at step 100, until it is determined that 
the maximum scaling factor has not been used (that is, 
step 1 18 is answered negatively). When images from a 
roll of a typical consumer's film (for example, containing 
up to 12, 24 or 36 images) are compressed using the 25 
method, and assuming that the storage medium 40 is a 
magnetically recording diskette of about 1 .44 Mbytes in 
capacity, typically step 1 18 will be answered negatively 
on the first or second cycle at most. 

If the maximum scale factor was not used then the 30 
difference between the actual size of the collection 
(from step 112) and the predetermined average size 
(from step 104) is determined (122). The predetermined 
average image size is adjusted by this difference and 
the same look-up table again traversed to find a new 35 
scale factor (124). In this manner, the compression 
function is altered based on the difference between the 
size of the resulting compressed image set and the pre- 
determined storage capacity. The collection of images 
is then compressed using this new scale factor (126) 40 
(that is, the altered compression function). The actual 
size of the compressed image collection is then deter- 
mined (back to step 112). 

The data for the look-up table described above, is 
obtained as an average figure using a large group of 45 
images (such as several hundred, for example about 
600) of a type to which the collection belongs. For 
example, if it is expected that the typical collection of 
images to be compressed are those of consumers, a 
very large group of many consumer images is obtained so 
and each image of the group compressed using each 
compression scale factor in the table. The average size 
of the resulting compressed images is then associated 
with that compression scale factor in the table. Similarly, 
the predetermined maximum scale factor can be ss 
obtained using such a large group of images, the maxi- 
mum allowable scale factor being the maximum value 
which still on average yields perceptibly adequate 



results for the class of users originating images of the 
type of which the large group is composed. Note that 
the look-up table and maximum scale factor will be set 
for a given resolution of the images in the collection, 
such as about 700 pixels by about 500 pixels. Whenever 
it is expected that images of a different resolution will be 
handled, a new look-up table and maximum allowable 
scale factor should be determined using a very large set 
of images having that new resolution. 

It will be appreciated from the above, that as many 
iterations as are required can be performed through the 
cycle of steps 112, 114, 118, 122, 124 and 126 as are 
required until step the compressed collection of images 
are reduced to a size which will fit on the storage 
medium 40 (that is, step 1 14 is answered affirmatively). 
As already discussed above, as many cycles as neces- 
sary can be performed through steps 118, 120 until the 
maximum scale factor ("Q") is not used in step 118. Fur- 
thermore, as to the alteration of the scaling factor, while 
this has been described using the look up table (which 
is a stepwise adjustment), other methods of alteration 
include interpolation, extrapolation or incremental 
adjustment, in any of which the scaling factor adjust- 
ment is a function of the difference between the size of 
the resulting compressed image collection and the pre- 
determined storage capacity. 

Either or both iterations in the preceding paragraph 
can be performed a sufficient number of times so that 
not only does the compressed image collection fit within 
the storage media, but is of a size no less than a prese- 
lected proportion of the predetermined storage capacity 
(for example, no less than 75%, 80%. or 95% of the pre- 
determined storage capacity). This ensures that close 
to all the storage space in a medium is utilized thereby 
maximizing the image quality. This additional step is 
illustrated in FIG. 4. 

The invention has been described in detail with par- 
ticular reference to certain preferred embodiments 
thereof, but it will be understood that variations and 
modifications can be effected within the spirit and scope 
of the invention. 

PARTS LIST 
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Claims 

1. A method of compressing a collection of images 
using a variable compression function, comprising: 

(a) compressing the set using an initial func- 
tion; 

(b) comparing the size of the resulting com- 
pressed image set with a predetermined stor- 
age capacity; 

(c) altering the function based on the difference 
between the size of the resulting compressed 
image set and the predetermined storage 
capacity; 

(d) compressing the collection of images using 
the altered function. 

2. A method according to claim 1 wherein steps (b) 
through (d) are repeated as necessary until the size 
of the compressed image set is no greater than the 
predetermined storage capacity and is no less than 
a preselected proportion of the predetermined stor- 
age capacity. 



steps (a) to (c) using the image sub-collection as 
the collection of images. 

8. A product according to claim 7 additionally compris- 
5 ing, for at least one image sub-collection, repeating 

steps (a) to (d) using the image sub-collection as 
the collection of images. 

9. An apparatus for compressing a collection of 
10 images using a variable compression function, 

comprising: 

(a) a first image compressor to compress the 
set using an initial function; 
15 (b) a comparator to compare the size of the 

resulting compressed image set with a prede- 
termined storage capacity; 

(c) a function modifier to alter the function 
based on the difference between the size of the 

20 resulting compressed image set and the prede- 

termined storage capacity; 

(d) a second compressor to compress the col- 
lection of images using the altered function. 



3. A method according to claim 1 wherein the initial 
function is based on a predetermined average 
image size. 

4. A method according to claim 3 wherein the initial 
function is based on an estimated compressed size 
of the image set selected from a look up table. 

5. A method according to claim 1 wherein the function 
is altered using interpolation, extrapolation, incre- 
mental adjustment, or stepwise adjustment. 



25 10. An apparatus according to claim 12 additionally 
comprising repeating means for iteratively causing 
the image to be passed through components (a) 
through (d) as necessary until the size of the com- 
pressed image set is no greater than the predeter- 

30 mined storage capacity and is no less than a 
preselected proportion of the predetermined stor- 
age capacity. 



35 



A product for compressing a collection of images 
using a variable compression function, defined by 
the steps of: 



40 



(a) compressing the set using an initial func- 
tion; 

(b) comparing the size of the resulting com- 
pressed image set with a predetermined stor- 
age capacity; 45 

(c) determining an altered compression func- 
tion based on the difference between the size 
of the resulting compressed image set and the 
predetermined storage capacity; and 

(d) comparing the altered compression func- so 
tion with a predetermined maximum compres- 
sion function and, when the maximum 
compression function is exceeded, splitting the 
collection of images into multiple image sub- 
collections. 55 



7. A product according to claim 7 additionally compris- 
ing, for at least one image sub-collection, repeating 
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